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ABCTRACT 



CoLie problems in the optimi-tm control of a linear cynamic 
system^ are investigated, particu.la.rly tlie problem of deter- 
mining the rniniir.nm time required to drive a linear, ccnstant- 
coefficient dynamic system from an initial state to a specified 
terminal state with a limited power source. The important 
feature of the paper is that an elementary method of solution 
for this problem is given. It is a method of successive 
approximations based on the adjoint system of differential 
equations in a way similar to that which Bliss used in cal- 
culating differentials in Ballistics. A program is given for 
solving the minimum- time problem on a digital computer: an 

elementary proof is given that if the routine converges then 
the solution thus found yields the desired minimum time. 

The forcing vector is assumed to have bounded components, 
representing limited driving pov/er or voltage. This forcing 
vector is to be selected as a function of time sc as to drive 
the dynamic system from one state to another in minimum tiiiie. 

In problems v/here certain control variables are bounded, it 
is vrell knoim that the control function assumes at all times 
either its maximum or its rndnimum value, changing dlsccntinucus- 
ly from one to the other. This is generally the case here. 

The problems v/ith this type of control are fi’equently referred 
to as Bang-Bang Control problems [l],[2],[3] . 

1. A system of differential equations v/ill be considered as 
representing a dynamilc system. 

2. References to the bibliography will be denoted by numbers 

in brackets [ ]. 
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The solution cf the rnininurn-t j me problem for an N-th 
order linear, constant-coefficient system, in v\rhich the matrix 
of coefficients has real and distinct eigenvalues, is given 
in matrix notation, including the set of differential-correction 
equations for determining the adjoint vector and minimum time 
associated with the desired terminal state. The solution of 
the adjoint system is given in teT-ras of exponential functions 
of the eigenvalues of the matrix of coefficients and the 
corresponding eigenvectors (see Appendix I), the components of 
v/hich are in the same ratio as the cofactors of the elements 
cf a column of the corresponding character j stic matrix of the 
original system (see Appendix II). 

The general case cf the second -order minimum- time problem 
vras programmed and run on the CDC-1604 computer. Because the 
convergence of the differential-correction equations may be 
critical, especially for stable systems, a search routine was 
incorporated into the program to search the input-parameter 
space for "useable" starting values. A second supplementary 
program provides for the plotting of minimum-time trajectories^ 
with initial state X(0) = 0 for anj'’ second-order system. 

The general third -order m.inimum-tirne problem was also 
programmed end run on the CDC-1604, using the general matrix 
techiniques described for the K-th order system. Extension of 
the program to K-th order could be accomplished directly. 

1. A minimum-time trajectory is the locus of points in the 
state space through which the dynam.ic system passes as it is 
driven from an initial state to a terminal state in minimum 
time . 
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A plot of the minim-um-tlme trajectories v;ith initial 

state X(0) = 0 for a particular stable system is included 

in illustration 2» This illustration also contains the 

switching curves^ associated with this initial state and 

2 

the region of static stability. Switching curves do not 
seem to have a very general significance, i,e., they are 
not implicit in the differential equations but depend on 
the initial conditions. It is to be noted however that 
for a second-order dynamic system and those minimum-time 
trajectories with two switching times, the time between the 
switching times is an invariant of the dynamic system. 

The method of differential corrections for the adjoint 
system \ms first developed by Bliss for making differential 
corrections in Ballistics [8], The set of differential- 
correction equations developed in this paper provide for 
the correcting of the input parameters to obtain the adjoint 
vector and minimum time associated with specified Initial 
and terminal states. None of the papers reviewed on the 
Bang -Bang Control Problem provide such a system. 

I would like to express my gratitude for the encourage- 
ment, guidance, and Inspiration which Professor Faulkner has 
provided, and without which this paper would not have been 
possible , 



1, A switching curve (surface) is the locus of points at 
which one of the components of the optimum forcing function 
changes sign. 

2o ,A point of static stability of the system represented 
by X = AX + F is a point such that an admissible force can 
be chosen to constrain the system to that point. That is, it 
is a point where < 1, (1=1,2, ... ,n) , and - 0, 

(1=1,2, c ,, ,n) for some aamissible force F (see section 4). 
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1. Introduction. 

Let us consider a liiiear dynoraic system represented by 
the system of djfferentisl equations in matrix form 

(1) X(t) = A X(t) + F(t) 
or componentwise as 

(2) Xj^(t) = E a^^Xj^(t) •+ fj^(t) (i = 1,2,... ,n). 

k 

Ihe matrix A is an n x n matrix v/ith constant elements 
and v;ith real, distinct eigeiivalues. 

X(t) is an n X 1 matrix representing a point or a state 
of the dynamic system. Kc distinction vdll be made generally 
betv;een an n x 1 (column) matrjx and a vector. If a quantity 
is to be considered os a vector, as in a scalar product, a 
bar (— ) v;ill be placed over it. 

The dynamic system is ccntrolled by a limj ted power source, 
i.e., the components f^Ct) of the vector forcing (control) 
function F(t) are restricted by the bounds 

(3) |f.(t) 1 < (i = l,2,,..,n) 

where the are preassigned constants. The may all be 
assumed to be 1 (one) without loss of generality, and this 
v;ill be the case henceforth « 

Tl\e principal problem under investigation is the deter- 
mination of the miniriium time required to drive the dynamic 
system from an initial state X(0) to a specified terminal 
state X^, and the determination of the control force F(t) 
which achieves this minimum time and the corresponding path 
or trajectory. 
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The solution is effected by using the adjoint system 
of differential equations. Certain properties of the adjoint 
gyspQiu malce this method, well suited, for the solution of this 
problem. 

The adjoint system of differential equations is a 
homogeneous system; the system adjoint to (1) and (2) is 
formally defined by Bliss [9] as 
(4) U(t) = - U(t) 

ivfhere the matrjx A need not have constant elements. The 
superscript T denotes the transpose of a matrix, 

VJritten componenWise , the system adjoint to (1) and (2) 
is 

(b) Uji^(t) = - II ” l}2,..,5n). 



Whenever the elements of A are constant the homogeneous 
adjoint system can be solved directly in terms of exponential 

T 

functions of the eigenvalues of the matrix of coefficients , -A , 
and the corresponding eigenvectors,^ 

The fundamental adjoint formula [9] of Bliss'^ 



( 6 ) 



allows us, by proper selection of the adjoint solutions 
(choosing those solutions of the adjoint system v/hj ch meet 
specified end conditions), to express the terminal values 
of the solutions of the original set of inhomogeneous equations 
in terms of integrals of the adjoint solutions and the forcing 
function of the dynamic system. 



1, See Appendix I. 

2, See section 2 for derivation and proof. 
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The order of development in this paper v/ill be as 
follows : 

First, the adjoint system of differential equations is 
defjned, and the relation is established betxireen solutions 
of the original system of equations and its adjoint through 
the fundamental adjoint formula, a form of Green's Formula [11 J. 

Second, the mininum=time problem is solved by applying 
the forcing vector such that its projection on a properly- 
chosen adjoint vector is at all times a maximum. This 
preperty is also knouT. as the Maximum Principle of Pontryagin. 

The solution requires the solution of a tv/o-point boundary- 
value problem. The method employed is a method of successive 
approximations, using the differential procedures which Bliss 
introduced in Ballistics, based on the adjoint system [8], 
Further, an elementary proof is given that a solution so 
obtained furnishes the mjnimum time. 

Third, an example is given of the solution of a specific 
second-order system through the use of the adjoint system of 
differential equations. 

Fourth, the solution of the general N-th order problem 
is derived in matrix notation for the case of a linear, constant- 
coefficient system of differential equations v;here the matrix 
of coefficients has real and distinct eigenvalues. This 
includes the differential-correction equations for determining 
the adjoint vector and the minimum time associated v/ith a 
specified terminal state. 



3 



I 



I 



Fifth, the techniques described above are applied in 
the programming on a digital computer of the solution of the 
aij:)i.':iun.-tirne problem for general second- and third -order 
systems . 
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o. The .ic'jcint Syrteri cf i>lffcren1.ial EqVictivnF, Green's Fcrmnla. 

Let rs ccnsi (''er a system cf linear c'if rerp->ntirl equations 
.Tittcn jn matrix form cs 

( 1 ) i«. ~ A. j\. + F 



cr cciiipcxienuv/ise 



"i ” ^ 



(i = 1,2, .. . ,n) 



v^here the elements a.,, cf matrix a ere cc.rstants (cr contimous 
functlc.is cf t) , and v^here f^^ are functions cf t [9], 

Def jniticn ; 

The system cf d j ffcrcntial equations adjoint to (1) aiid (2) 
is fined l 9] as 

( 3 ) i = 



U 



:r cemreneritv/ise as 
( 4) u . = - Z s, .u, 

1 ^ ivi k 



Thccr ei iontal Ad.jcr'n t F crmijla) [ 2 ] : 

If (( 2 ) X. ^ Z a.^.Xj^ -♦ f, 



.(4) u. 






(i = 1,2, 

(i = 1,2, 
(i = 1,2, 



where (4) is the adjoint of ( 2) , 



then (5) d 



TT ( Z u^x^) = Z ; 



this nust held for every solution of (2) and (4). 
Froef : 

Censider the Laaranpe Identity [11] 

(6) _a 

V L. u.x^j = 

_• 1 J_ 

1 



T -u n- XX XX 



,n) 



,n) 

,n) 
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Substituting (2) and (4) into (6) we get 



( I “i“i> ' fV I “ik*k ♦ '■i> *i<-| »kiV* 

Expanding (7) \^re get 

T$( ^u.x.) = T y\ a.,u.x, + ^u.f. -■ > 

d t 4- 1 1 ik 1 K V 1 1 ^ ^ k3. k 1 ’ 

J«, JL X*. JL iV 

and, interchanging the meaning cf i and k in the last term, 
rr^(^u.x. ) =ZEa.,u.x, + )^u.f. - EHa.,u.x, , 

ot' V 1 i' V ik 1 k T 11 vT . IX 1 k ’ 

1 1 k 1 k 1 

which upon interchanging the order of sumniaticn in the last 

term beccmes 

Hence we get the final result, the Fundamental Adjoint Fornmla 
cf Bliss [9] ; 



^(Z V.x.) = Zu.r. . 

ot pT 11 4" 11 



Alternatively, the Fundamental Adjoint Fcrraula can be 
v/ritten in integral form as 

UD [ L = J ^ ( L «3t . 

This form is often referred to as Green's Formula [11]. 
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3. Outline cf Scluticn, iTelimjnnry Forr;ml£is. 

Let u? ncv7 ccnsiner tiic system cf c-if ferential equations 
discussen in secticn 1 

(1) X(t) = A X(t) + F(t) . 

In this paper the dimension of F(t) is the same as that of 
X(t), though this is irrelevant to the method cf solution. 

Given an initial state X(0) of the dynamic system and 
another state X^ (referred to as the terminal state) , we 
desire to determine hov; to drive the system from X(0) to X^ 
in minimum time by proper application of the control force 
F(t). 

The scluticn of the mini mum -time problem consists 
basically of the fcllov/ing steps: 

a. Equations are obtained from Green's P’orraula^ (2.11) 

to express the terminal values of the system state variables 
in terms of the initial state values, the time, an<' an 
integral involving the forcing functjcn F(t) and the solutions 
cf the adjoint system, 

b. It is established next that if a solution is obtained 
v/hich maximizes a certain integral and satisfies the desired 
end conditions it is the desired scluticn. 

c. Only solutions are sought \/hich maximize an integral 
of this form. However, there are some parameters in the 
integral, and these must be determined sc as to yield the 

1. Equations from other sections will be denoted by decimal 
numbers; the number preceding the decimal point indicates 
the sect j on, and the number fcllcv/ing indicates the equation 
number in that section. 
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desired end ccinditicns. The prcblern reduces to the solution 
of a tv/o -point boundary-value problem. 

d. This problem is solved by a I'.iethed of successive 
approximations. Tho corrections to the input parameters 
are obtained by a method based on Bliss' method of computing 
dif ferentials in Ballistics. 

DeSoer [2] proves the existence of a minimura-tine path 
for stable systems. 

The solution of the adjoint system obtained in the 
process defines the functional for the Kaxirainri Principle of 
Fcntryegin [ 7 ]. The Integrand of the functional is the 
scalar product of the forcing vector and a vector defined 
by the solution of the adjoint system of differential equations. 

vje therefore have under investigation the dynaaiic system 
governed by the system of differential equations 

(1) X = AX + F . 

T’iie system adjoint to (1) can be vrritten directly as 

(2) U = - A" U, 

From the Pi^ndaraental Adjoint Formula (Green's F’ormula) 
we get, choosing t^ = 0, tg = T, 

T T 

(3) [ E = r (I dt . 

^ o ^ 

Let us now examine the solutions of the homogeneous 

adjoint system. From Appendix I we see that (fer n distinct 

T 

eigenvalues -m. of matrix -A ) there are n distinct solutions 
of the adjoint system of the fcriu 

(4) = e"^j^ (j = l,2,,..,n) 
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v.'licre is the 
v/lth eigenvalue 



eigenvector .... 

-m^. = [uj -u^ ]^. 



associated 



Since the solutions are independent solutjcns of 
the adjoint system, it follows that the general solution 
of the adjoint system can be v/ritten as a linear combination 
of the , i.e, , 

(b) U = X! k . v/here the k. are arbitrary constants, 

j ^ ^ 

Substituting (4) into (b) results in 

(6) U = Z k,- C^. 

;) 



Suppose v/e nev; select a set of "special" adjoint 

T 



solutions 1 } . = [un . u^. .... u .] , (j = l,b,...,n) 

v.'hi ch meet the following end conditions: 

(7) U.,(T) = =/l , 1=3 

lO , i j 

We see then that the terminal values x.(T) of the 

J 

Eolr.ticns of the original system of equations can be deter- 
mined by successively substituting the "special" scluticns 
of the adjoint system into the fundamental formula (3). 

That is, substituting in U. in (3), v;e get 

J 

T T 

(£) [ Z u^.Xj = J ^ ( I cU 

'•■hich, since u..(T) = 1, u. .(T) = 0, i/j , reduces to 

J J J 

T 

(9) Xj(T) = Z u,^(0)x^(0) +J ( Z u^^f.)dt, (j=l,2,...,n) 

^ o ^ 
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If we consir'er L . ss e vector in c cartesiin coorc'inrte 

I 



set v/ith base vectors then 

(10) Uj = E 



If we also define a vector X, the system state vector, by 
the equation 



(11) X = I 






then equation (9) can be written as 

- _ r^‘ - - 

(12) x.(T) = (U..X)^ + (U..F) dt (j = l,2,...,n) 

J 0 c j o J 

Since the are in(5ependent scluticns of the adjoint 

J 

system a linear combination of the U. is also a solution, 

J 

(13) U = Ui + biUg 4 ......4 b^_^U^ 

v;here the b. are arbitrary constants. 

J 

A solution b defined in this way is called an ad.jcjnt 
vector . 

From (12) v/e have the following equations, obtained by 
successively substituting in the TJ. into (3); 

J 

'T 



Xi(T) = (tli.X)^ 4 r (Ui.F) dt 

J o 

(U^.F) dt 



o 

- _ oT 

Xs(T) = (Us.X) 4 

■J o 



(14)< 



_ _ - ~ 
^x^(T) = (Uj^.F) dt 

■J o 
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If v/e fcr/i any Ijnear ccrnbinstjcn of the above, usinf 



pay the b. of (13), we get 
J 



(lb) Xi(T) + biX2(T) +•••+ 



(U,F)dt 



Equations (14) and (15) are the fundamental equations 
for the solution of the problem, 

vie shall hereafter consider only forcing vectors F such 
that the scalar product (U,F) is a maximum. In the next 
sections it will be seen hov/ this characterizes the solutions. 
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4, A Theorem on Minimum Time. 

In this section it will be shown that if an admissible 
trajectory can be found which satisfies a maximizing principle, 
then, at least under the conditions given below, it furnishes 
the desired minimum time. 

An admissible trajectory is one which has the specified 
initial and terminal points; with it must be associated an 
admissible forcing function. An admissible forcing function F 
is one which satisfies the constraints on its components, 

|fj^| < 1. In this section no specific assumptions are made 
regarding the eigenvalues of the matrix A in the system of 
differential equations 
(1) X = A X + F 



but A is assumed to be a constant matrix. 

A point of static stability of (1) is a point such that 
an admissible force can be chosen to constrain the system to 
the point. That is, it is a point where | Z I ^ 



j 



(i = l,2,,,,,n), and x^^ = 0? (i = l,2,..,,n) for some admis- 
sible F. A point such that | ^ a^^x^ 1 =1, (i = l,2,...,n) 
is a vertex point of the points of static stability. 

Now suppose we have in some way found a path and a 
vector which together satisfy the following relations: 

H.l. The path is admissible for some value of T, say T"*^, 

H.2. = Uj + biUg + , . . .+ b„ is a solution to the 

n-j. n 

adjoint system of differential equations. The U. are the 

J 

"special" solutions defined earlier, and the b's are kno\\m 
constants. 
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K.3. For each value of t, the force F"*^ associated with C 
is such that the scalar product (F'*^.u'*^) is a maximum. 

H.4. Each component (i = l,2,...,n) of U vanishes 

at most at isolated points in (0,T ). 

Theorem . The trajectory c"^ which satisfies H.l, H.2, H.3, 
and H.4 yields the minimum time T*^ and is unique, compared 
v/ith all paths which contain a point of static stability 
that is not a vertex point. 



Proof . Consider equation (3.16) v;ith the values bj,....,b ^_2 
from H.2 for any admissible trajectory for time T . 



(2) + ^i^2f ^ 



'n-Af 



(ij'^.X)^ = j (u",F*')dt. 



We shall see that F"*^ maximizes this and then as a consequence 
t"*” is minimal. Note that every term on the left side of (2) 
is determined by the specified conditions Xq, X^ and the 

quantities bi , . . . . ,bj^_-j^, T . 

Now consider the force F”^ above and any other force F' 





I 




■m 






t 

• * 



I 

i 



ij 






■3#* i» 
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admissible path for that value of T. 

There might conceivably be, however, a path C" with a 
smaller value of T, Assume this to be the case and assume 
that there is a point of static stability on C”. 

Let t"*^- T = AT, and let t be the time associated with X 
on C". 



The force function F' constructed as follows then will 
lead to an admissible trajectory C with T = T**”: 

0 < t < t 



/fi"(t) 






r 



^ij^js 



fV(t-AT) 



t < t < t +AT 
s s 



t^+AT < t < T . 

o 



The middle segment of C constrains X to X for an 
interval of length AT, and the two end segments then lead 
from Xq to X and from X to X„, 

5 S X 

Nov/ note that 



( 4 ) 



F')J dt > 



t^+AT 

s 



[u"^. (F"^- F' ) ] dt, 



and, for at least one value of i, 



(5) 



/ 



t3-AT 



(fj - q) > 



since uT has only Isolated zeros and (f^- ^l^^i “ i f|)|uti. 

But c"*” is the only admissible path associated with 
time There is then a contradiction. It arises from the 

assumption that a second path with T < T'"*^ existed. This 
completes the proof; if such a path is found, it defines 
the solution and is unique. 
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Clearly the proof holds if in H.3, (F'*^.U'*^) is a minimum 
rather than a maximum on C"^ . 

Corollary . If the matrix A has real distinct eigenvalues, 
if either X© or is a point of static stability which is 
not a vertex point, and if a curve C**^ and an adjoint vector 
have been found which satisfy H.l, H.2, H.3 with none of 
the b's of H.2 zero, then c"*^ defines the minimum value of T 
and is unique. 

In this case every trajectory contains a point of static 
stability Xo or X^ which is not a vertex point. Every uT 
has the form u. = L c . . e J with at least one c. . 

1 j ij 10 

distinct from zero for each value of i. It has at most 
n-1 zeros, and satisfies H.4. All of the hypotheses of 
the theorem are satisfied by C"*^, 

If the values of bj,,..,, were known, it v/ould 

be just a matter of integration to get the trajectory by 
setting fj^ = sgn u^. In the next sections these will be 
determined by a method of successive approximations. 

The proof of the theorem in this section is due to 
Professor P’aulkner. 
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5. Example of a Specific Second-Order Problem and Solution. 

In this section the solution of the minimum- time problem 
for a specific second-order stable system will be worked out 
in full detail. The solution consists basically of the fol- 
lowing steps j 

a. The aa joint system of differential equations is solved. 

b. rt set of input parameters (T,b) is selected, and a set 
of "special" aajoint solutions (with the corresponding adjoint 
vector) is determined. 

c. The terminal values x(T), y(T) of the dynamic system 
are expressea as Integrals involving the "special" adjoint 
solutions and the vector forcing function, and a trajectory 
is determined by the Maximum Principle, 

d. The resulting terminal state (x(T),y(T)) is compared 
with the required terminal state (X^,Y^), and the changes in 
T and b required to effect (X^,Y^) are determined from a set 
of differential-correction equations. 

The dynamic system which will be considered is governed 
by the pair of linear first-order differential equations 



The system of differential equations adjoint to (1) 

can be written directly as 

* 

1 = u + 2v 



I X = “X+ y+f 



|f| < 1 

|g| < 1. 



( 1 ) 




( 2 ) 




V = -u + 4v 
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•Moouei au^^f«ii9 •^cii silf* ? 

i 



(4) M 



The characteristic equaticn of matrix A is 



( 3 ) 



-1-m 1 

-2 ■ -4-m 



= 0 



The eigenvalues of A, roots of (3), are m = -2,-3. 

Now, if mi, are eigenvalues of matrix A, then -mi, -m 2 

T 

are eigenvalues of -A . 

2t 3t T 

Hence e , e and the eigenvalues of -A will define 

a fundamental set of solutions of the adjoint system (2). 

Denote these solutions by U^, U® where 

(4) = fui'i U2 = \u^' 

[vij i|_v2J 

From Appendix I we know that for each distinct eigen- 
T 

value of “A , the corresponding solution of the adjoint 
system can be written in the form 

(5) 

T i 

where -m. is an eigenvalue of -A, and is the corresponding 

J 

eigenvector. 

Since the eigenvalues are real and distinct, we know 

(see Appendix II) that the components of are in the same 

ratio as the cofactors of the elements of a column of the 

characteristic matrix [A - m.l]. We can therefore determine 

J 

that 



( 6 ) 



'1 _ 



iCii 

! 

j C21 



2 

1 



c" = rci2 

|_C2 2 



= 2 
2 



Then the solutions of the adjoint system are 



(V) 



yi = Qi 



= e 



2t 



[2 

UJ 
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and 

(8) U- 



= e 



-nigt 



C2 = [2 



l2j 



Since U^, 1)® comprise a fundamental set for the adjoint 
system (2), U = kiU^ + is also a solution, i.e., 

(9) U = kie‘ 



r 2 “ 


-*■ kse^^ [2 ■ 




'2 2 ' 


fk,e2‘l 




* 




1 2 





where the k’s are arbitrary constants, 



T 



We will denote the matrix of eigenvectors of -A by C, 



where 



(10) C = [C^ C^J = 



2 

1 



Inverting C we get C” =f 1 



X 

2 




Let us nov/ return to the original set of differential 
equations (1) which we may write as 

(x + X“ y-f = 0 

( 11 ) ( . 

|y+2x + 4y-g = 0 

Suppose v/e now multiply the first equation of (11) 
by u and the second by v, where u,v are required only to 
be continuous functions of t which have continuous first 
derivatives. Adding the two products and Integrating the 
sum from 0 to T, we get [4] 




x+X“y“f)+ v(y + 2x + 4y - g)]dt = 0, 



Note that if x,y are solutions of the original set of equations, 
then u,v used in this way are called Lagrange multipliers. 
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Integrating (12) by parts we get 

T /- 1 o • 

(13) [ux + vy] +1 [x(-u + u + 2v) + y(-v - u + 4v)]dt 

^ J o 

T 



- r [nf + vg] dt = 0, 
o 



If we now choose n^v as solutions of the adjoint system, 
v/e have 

2v = 0 
4v =0 



(14) 



f -u + u + 
\ _V - u + 



If u,v are thus chosen, (13) reduces to 
T fT 

(15) [ux + vy]^ = / [uf + vg]dt 

o 

Note that (15) is a particular example of the Fundamental 
Adjoint Formula of section 2, 



Suppose we now choose a set of "special" solutions of 
the adjoint system as follows; 

(16) Ui = rui"* such that Ui(T) = 1 

\vi Vi(T) = 0 

and 



(17) 



U 



2 



U2 

Vg 



such that Ug(T) = 0 
Vg(T) = 1 



Substituting Hi into (9) we get, evaluating at t = T 



(18) Ui(T) = [ui(T) 




‘2 


2’ 




kii© 


= 


’ 1^ 


j 

|_Vi(T) 




1 


2 

•J 




Lk21® J 




- 



Note; The second subscripts of kn, kgi indicate that they 
correspond to the first solution Ui, 
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Multiplying (18) through by C" we get 
2T-J 



(19) 



i kije 

‘ ksie 



3T 



= C 



-Ir 1 



L°J 



oiii 



where the are elements of C' 

=2T 

Therefore kn = e 



ksi - 6 



-3T 



= 11: 

J 

-1/2 ! 



{ 

I 

I 

L 



Then 

(20) rui(t)1 

Vi(t)| 



f 2 2 

I 

i 1 2 



,2(t-T)j 

,3(t=T)' 



-2 



Similarly, substituting IJ 2 into (9), we determine that 



(21) 


ki2 




e” 


2T 




k22 = 




e” 


•3T 


so that 










(22) 


U2(t) 


- 


'2 


2 if 




|_V2(t) _ 




1 


2 i[ 


Substituting Uj. 


into 


(15); 



„3(t-T)! 

® J 



(23) x(T) = Ui(0)x(0) + Vi(0)y(0) + f [uif + Vig]dt. 

J o 

Substituting U 2 into (15), we get 

/"T 

(24) y(T) = U2(0)x(0) + V2(0)y(0) +J [u 2 f + V 2 g]dt. 

J o 



Let us now consider the “special” adjoint solutions 
as vector functions 

(25) Ui = Uiei + Vj.e2 
^2 = "^2®! ^262 

where ej, ^2 s-^e the base vectors for a cartesian coordinate 
set in two dimensions. 
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Since Uj and Ug are independent solutions of the adjoint 
system, a linear combination of these is also a solution, i.e., 

(27) U = Ui + bUs 

= (ui + bU2)ei + (vi + bV2)e2 
= u ei + V 02 

Combining (23) and (24) in the same linear combination, we 
obtain 

(28) x(T) + b y(T) = (ui+bU 2 )qX( 0) + (vi+bvg )Qy(0) 

/•T 

+1 [(ui+bU2)f + (vi+bV2)g]dt. 

J o 



which can be written as 

(29) x(T) + b y(T) = u(0)x(0) + v(0)y(0) + j [uf + vg]dt. 

J o 

Defining vector R = xei + ye 2 , we can revarite (29) as 



rT 

(30) x(T) + b y(T) = (U.R)^ + j (D.F)dt. 

® v' o 



v/here F = fei + g . 



Suppose now that we desire to drive the system from 
(x(0),y(0)) to (X^,Y^) in minimum time. As we have seen 
earlier (section 4), this may be accomplished by applying 
Pontryagin" s Maximum Principle to (30), i,e., by choosing 
the vector F = f"*^ such that the projection of F"*^ on the 
adjoint vector U is at all times a maximum. That is, 
we choose F"*" such that its components satisfy the following 
relations ; 

( = sgn u 

(31) ( 

I g = sgn V, 
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Equation (30) then can be rewritten as 

(32) x(T) + b y(T) = (U,R)^ + ( (U.F^)dt 

° ) o 

v/hile (23) can be rewritten as 

T 

(33) x(T) = (UioH) (iJi.F"^)dt , 

- 0 

and (24) can be rev/ritten as 

(34) y(T) = (Us.R)^ +! (U 2 .F'")dt, 

However, the value of T which we have selected is only 
a "guess" at the actual minimum time required to drive the 
system to (X^,Y^), and the constant b is only a "guess" for 
the linear combination of Ui,U 2 to determine the proper 
adjoint vector associated with the desired terminal state. 

We must therefore compare the resulting state (x(T),y(T)) 
v;ith the desired terminal state (X^,Y^) to determine the 
errors 

(35) [ - x(T) = M. 

[ Y^ - y(T) ^ AY 

and determine the changes ST, Sb required in the input 
parameters to drive the system to the desired terminal state. 
For this we will derive a set of equations to determine 
STf 6b, Suppose we replace T and b by nearby values 

(36) j T T + 6T 

1 h b + 6b 
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Now, OTitlng x(T) = x(T,b) and y(T) = y(T,b) since the 
terminal values are implicit functions of b, we get 

(37) f x(T,b) ^ x(T+ ST,b+ ^b) = x(T,b) + SX 

[ y(T,b) ^ y(T+ 6T,b+ ^b) = y(T,b) + 6Y 

plus terms of higher order. 

Now 



(38) 



^ Cm . ^ 

= ^rm . Mxk 



where 6x, Sy denote the total differentials of x(T,b) 
and y(T,b) respectively, l.e., 



f 




(39) 




5T 

eT 




8b 





We can rewrite (38) as a single matrix equation 



‘6x1 


= '‘ax 


4\ 


'S t‘ 


• 

= e 


- St' 




1 8T 


8b I 






1 

>H 


'M 


I 

M ! 


6b_ 







^8T abj 



where £" is the matrix defined in (40). This matrix is 
called the "correction" matrix. 

Multiplying (40) through by £" and setting Sx = AX 
and Sy = AY, we get 



(41) 


”ST‘ 


i e-" 


'5 x‘ 


= e 


'x^-x(T)' 




5b 








_Y^-y(T)_ 



Equation (41) will be referred to as the "correction equation 



Hence we have determined the changes (§T, 6b in the 
input parameters required to drive the system to so 

that 

(42) r x(T + 6T, b + 6b) = 

\ y(T + 6T, b + 6b) = 
except for higher-order terms » 

Therefore we have solved the minimum-time problem 
assuming we can determine the elements of the "correction” 
matrix, and if the routine converge So 



We will first determine ^ . 

5T 

T 

J (Ui.F^)dt. 



where X = x(T) = + 



On a minimum-time trajectory each component of a 
tv/o-dirnensional forcing vector will switch (change sign) 
at most one time if the eigenvalues are real. These 
sv/itching times are defined by the equations 

(43) 



j ^(tj 


i) = 


0 , 




f 


sv/itches : 


1 v(tj 


J = 


0 , 




g 


switches 


ti , t2 


as 




0 


< 


k < K < 2 


JO = 


to 




k 


= 


0 


II 


^K-»-l 




k 


= 


K 



so that 0 < k < K < 2. 

Viith the above notation, we can express (33) as 



(44) x(I) = (Ui.H), 



^ / 

k=0 t, 



(Ui.F'^)dt 



where the integrand is continuous over each subinterval 
of integration tj^^ to 
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To simplify notation we will make the following 



definition; 



(45) L = (liioF'') , 



Then (44) can be rewitten as 






(46) X » (Ui.R)^ + 



K r' 

?/, 



k+1 



Ik at. 



Applying Leibniz' Rule for the differentiation of a definite 
integral the limits of which are functions of a parameter [5]j 
we obtain 



tf = (fl'-S)o ^ at 



^ I ik<*k+f iik-n 

° eT 



K 

o ^ eT 



or if [ ]. denotes the discontinuity (jump) in a function 

at point tj^, we can incite (47) as 



(48) dX 

eT 



(SUl R) 4 

''eT °-“^o 






)dt + (ili.F), 



Z (Ui.[F ])4 Mi 
1 eT 



v/here K = 0, 1, or 2. 

Now, for fixed b, It is readily seen that et i, _ 

eT “ 

so that (48) reduces to 



so 



(49) ^ 

eT 



= (§f"»R)o (ff^F^)dt + (Ui.F'*'), 



K 

/L 

1 
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Similarly, 



- t (Us.Lr'^Dt 

1 

By the same methods v/e can determine that ^ and ^ 

eh Ob 



can be expressed as 

K-1 

(51) M 

eb 



= - Z 



and 



k=0 



K-1 



k+1 



6t 

eb 



k+1 



(62) |X = „ X! (U-[f'']) 



eb 



k=0 



t ^^k +1 

etr " 



Ok 



5t, 



To completely determine and ^ we must determine ^ ""k +l 

These can be determined by making the following linear 
approximation of the change in the switching times, denoted 
by 6 ti (and 6 t 2 )s 



t. 



(53) 


6ti = - ou 1 = 






U • 1 1 


L 11 J 



and since u = u(T”t), it follows that u = 



6 b = 6 t 



eu 

8T 



so that 


(53) 


reduces to 












8u 


(54) 


6t 


1 = 6t 


«=, « 


eb 

• 










u 


so that 










(55) 


eti 










8b 


• 

u 






Similarly 5 






(56) 


eb 


- „ V2 

e 










V 


t2 





U; 

i2 



6b 
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Having determined 



we can now write the final 



expressions of dX and QY as 

eb ab 



(57) OX _ 
eb 



and 

(5f) QY _ 

eb 




vve have now determined all the elements of the "correction" 
matrix, so that the minimum- time problem is solved, if the 
routine converges. 

In this section vre have developed the solution of the 
minimum-time problem for a specific second-order system, Hov/ever, 
each step of the solution has been derived in general notation 
before substituting in the numerical values. It is therefore 
unnecessary to repeat the development for the general case for 
second-order systems. In the succeeding sections, the solution 
of the problem for the general case will be developed for 
higher-order systems. 

An Interesting property of second -order systems was 
discovered; it is the follov/ing; If a minimum-time trajectory 
for second-order systems has two switching times, the time 
betv;een these switching times is an invariant of the dynamic 
system. An elementary proof of this result is given in 
section 8. 
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6. Derivation of Solution for Third-Order System. 

Suppose we have a set of three inhomogeneous linear 
first-order differential equations with constant coefficients 
representing a dynamic system 
(1) i = A X + F 

where X = [xi X 2 F = [fi fg fa]^? and A is a 3 x 3 

matrix with constant elements a^^^. The eigenvalues of A 
are assumed to be real and distinct. 

The characteristic equation associated with matrix A 
is 



( 2 ) 1 


A - ml 


1 = 


0 , 


e 0 9 








(3) 


aii-m 


^12 


^13 




^21 


a 22 "m 


®2 3 




3^31 


a .32 


a33-m 



which, when expanded by determinants, becomes a cubic 
equation in m of the form 

(4) m^ + bjm^ + bgm + ba = 0, 

Denote by mj, m 2 , m 3 the roots of (4), i.e., the eigenvalues 
of matrix A, 

T 

Then -mi, -m 2 , =013 are eigenvalues of -A . 

Therefore, if we consider the system adjoint to (1), 
which is 

( 6 ) U = -A^ U where U = [ui U 2 Us]^ 

then and the eigenvectors of -a”^ will 

define a fundamental set of solutions of the adjoint system. 



28 



Let us consider the solution of the adjoint system (5) 

T 

in terms of the eigenvectors of the matrix of coefficients , -A . 
We have 

(5) i = - U. 

Assume a solution of the form 

f,-*- rri 

( 6 ) U = e^ C where C'= [ci C 2 C 3 ] is a constant 



vector. 

Differentiating ( 6 ) with respect to t, we obtain 

(7) i = T e^^ c' 

Substitution of (7) and ( 6 ) back into (5) gives 
rt ,T _rt 



( 8 ) 



r e 



C ' = -A e* ' c » 



rt 



and since e is a scalar quantity appearing on both sides 
of the equation, it follows that 
(9) r C' = -A^ c'. 



.T 



Therefore, if we choose r as an eigenvalue, ^ 5 of “A 

then C'is by definition the corresponding eigenvector. Hence, 

T 

for each eigenvalue of -A we have a unique solution of the 
adjoint system if the eigenvalues are distinct. Therefore, 
we have the following fundamental set of solutions of ( 5 ) ; 

Ui = ni 



= e 
= e‘ 
U3 = 



U 2 = qz 



Then any linear combination of U® is also a solution 

(10) U = kie"™i^ Cl + kse’^^^t ^2 + kae"""®^ C® 
where the k's are arbitrary constants. If (10) is written 
in expanded form, we get 



(11) U = kie"“i^ 






'O 12 ' 


+ kge"®®^ 


1 Ci3 




C 21 




C 22 




*^23 




1 

0 

1 




C 32 




•233 
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Equatloii (11) can then be expressed as the product of 



two matrices, as follows: 







Cii 


C12 


Cl 3 


r 1 


U 2 




C2I 


C22 


C23 


. kse -” 3 t J 


^3 




C31 


C32 


C33 



where 




^11 


C 12 


Cl3 




C = 


C 2 1 


C 22 


C 23 






C 31 


^32 


C 33 



T 1 

is the matrix of eigenvectors of -a „ 

Then, the general solution of the adjoint system 
can be written as 





Ui 




'kie"”**] 


(12) 


^^2 


= c 






U 3 




.kae-®^* 



T 

We will now choose a "special"solution Uj = [uu U 21 U 31 ] 
such that Uii(T) = 1, U 2 i(T) = 0, UaiCT) = 0, Substitution 
of Ux into (12) evaluated at t = T gives us 



(13) 



Uii(T) 

u 2 1 ( 1 ) 

^31 (T) 



-j 






1 


= c 






0 








.0. 



where the second subscripts of the k's indicate constants 
corresponding to solution Ux, 



Multiplying (13) through by C” we get 





kije ^ 




1 




r 

^11 


(14) 




= c-1 


0 




^2 1 




_k3.e-“3l_ 




_0_ 




_^31 



v/here the c 






are elements of C 



=1 



o 



1, See Appendix II for determination of components of 

in terms of cofactors of [A = m.l]o 

J 



30 



Then 



( 15 ) 




» miT 
= cii e ^ 

' moT 
= C21 e 2 

» moT 
= C31 e 3 



Substitution of ( 15 ) back into ( 12 ) gives 

"mjt' 



( 16 ) 



Uii 

U21 

1^31 



kiie 

ksie' 

kaie' 



-mgt 

-mat 



= C 



ch 



Similarly, we can choose a second "special" solution 
T 

U2 = [ui2 ^22 ^32] of the adjoint system satisfying the 
end conditions Ui2(T) = 0, U22(l') = 1> ^^32(1) = 0) which 
results in 



(IV) 



U12 

^22 

U32 



« ma(T-t) 



C32 6 

and, choosing a third ^’special** adjoint solution 

T 

U3 = [^13 ^23 naa] satisfying the end conditions 

Uia(T) = 0, U2a(T) = 0, U3s(T) = 1, we obtain 

mi(T-tJ 



( 15 ) 



^13 

^23 

^33 



Ci3 e 

0^3 

' ma(T-t) 



If we group ( 16 ) 
equation, we obtain 



C33 e 

( 17 ) , and ( 18 ) into a single matrix 



( 19 ) 



■>^11 ^12 ^13 
■^21 '^22 1^23 
^31 ^32 ^33 



= C 



<^11 



,mj(T-t) 












( 20 ) 



( 21 ) 



[U] = C 



;mi(T-t) 



[U] = C E C 



0 

0 

-1 



0 

^m 2 (T-t) 

0 



0 

0 

ma(T-t) 



where E is the diagonal matrix with j^'^diagonal element 
and [U] = [Ui U2 U3]. 
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V 




Since Uj, Ug, U3 are solutions of the adjoint system 

then any linear combination of these is also a solution: 

(22) U = Ui + biUs + bgUa 

T 

v;here U = [ui U2 U3] ; 



' Ui 


= Uii 


+ 


biUi2 




baUis 


u. 


= ^21 




t>lU22 




t) 2 U 23 


I U3 


= U31 




biU 32 




CO 

CO 

P 

a 



Written in matrix form, the above set of equations becomes 





’■Ui'l 


Uii U12 1^13 




~1 


( 23 ) 


U2 


^21 ^22 ^23 




bi i 




^3 


Uai U32 U33 




t>2 1 



Let ej, 62, ea represent the base vectors of a three- 
dimensional cartesian coordinate system. We can then 
express Uj, U2, U3 as the vectors 

Uj = Ujjei + U2i02 + UajOa 

( 24) U2 ~ Uj2®l ^ 22^2 ^3263 

^3 = UjaCi + U2362 + U3303 

Then U = Ui + L1U2 + L2U3 can be vrritten as 

(26) U = (^ll'*’ ^>2^13)®! "*■ (^21'*' ^1^22 ^2^ 23)®2 

+ (uai+ biU32 + b2U33)ea 

which can also be written as 

( 26 ) U = uiei + U262 + Uaea 

A solution U obtained in this way is called an adjoint 
vector . 

If in the Fundamental Adjoint Formula we let ti = 0 
and t2 = T, we have, from ( 2 , 11 ), 

™ T 

( 27 ) [ E u.x ] = / ( Eu.f.)dt. 

i o i ^ ^ 
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If we desire to determine x.(T), we choose the adjoint 

J 

solution U = U.. This reduces (27) to 

J 

(28) x^(T) = (^u..x.)^ + J (Iu..f.)dt (j=l,2,3), 

which can be written in equivalent vector notation as 



(29) x.(T) = (U..x)^ + J (U.,F)dt, 



(j=l,2,3), 



where X = Xjej + XQe 2 + Xaea, 



vj'e wish to drive the system from state X(0) to X^ in 

minimum time T, '4e therefore consider a linear combination 

of the x.(l), using say the constants b. of (22), Vie get 
J J 

(30) Xi(T) + biX2(T) + b2Xa(T) = [ (Uj + biUg + bsUa).)^]^ 

T 



*■ f L(Ui + bibg + b2b'3).F]dt. 
J o 



which can be written as 

r - 

(31) Xi(T) + biX2(T) + b2X3(T) = (tJ.X)^ + (U.F)dt, 

J o 

Applying Pontryagin's Maximum Principle, i,e., by choosing 



F = F such that f^ = sgn u^, we obtain 
(32) Xi(T) + biX2(T) + b2X3(T) = (U,X), 






(U.F )dt 



We now compare the resulting terminal state X(T) v;ith 
the desired terminal state X^, and define the component errors 



as 



( 33 ) 



Xff 


- Xi(T) 


= AXi 


^2f 


- X2(T) 


= AX2 


^‘ 3 f 


- Xs(T) 


= AX3 e 
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If any A}... (j = 1,2,3) is not zero, we must determine 
the changes oT, 6 b j, 6 b 2 in the input parameters required 
to effect Suppose the initial input parameters are 

replaced by nearby values 

' I _> T + 6T 

(34) / bi ^ bi+ 6 bj 

bg - 61 ^ 2 ' 

Then the resulting changes dX. in the terminal values x.(T) 

J J 

are determined to be (for j = 1,2,3) 



(35) 



5X. 



(f^j. X) +r^ "L (u. .[f^]).^ 

ei o J ^ 6 i ij 1 






■f 



3 



I 

1=1 



% 

I 

k=l 




St 






3 Ki 
r V 
A- 

i=l k=l 






■U. 



^13 



t 

ik 



6 bg 



where K. denotes the number of zeros of u.» and t., the cor- 

1 IK 

responding times. Equation (35) has the form 



(36) f5x. = 6 T + & <5bi + 

J Ol oDjL 0D2 

Setting oX. = AX., and inverting the " 
J J 

matrix defined by (36) , we can determine the 
6 T, 6 bi, 6 bg to effect X^. 



Obg (;i=l,2,3) 

correction” 
required changes 



7. Derivation of Solution for N-th Order Systems. 

Let us consider a linear dynamic system of the n^*^ order 
represented by the system of differential equations 

(1) X = A X + F 

where A is an n x n matrix with constant elements a^^j^ and 

T 

with real and distinct eigenvalues. X = [xj X£ .... 
and F = [fi fa .... 

The system adjoint to (1) can be written directly as 

o m 

(2) U = - A-' U 

T 

where U = [uj Ua .... • We know from Appendix I that 

equation (2) has solutions of the form 

(3) U = Z k . e"“j^ 

T i 

v/here -m. are eigenvalues of matrix -A , and the C*' are the 

J 

corresponding eigenvectors. 

Equation (3) can also be witten in matrix form 



as 



(4) U 



C 






o 

k 

i_ n J 

where C is the n x n matrix composed of the eigenvectors , 
i.e,, C = [C^ .... C^3 where the eigenvectors are n x 1 

column matrices. 

If v;e choose a "special" solution Di = [uu Uai ***^nl^^ 
to the adjoint such that Uu(T) = 1, Uai(T) = .... = u^^(T)=0, 
then equation (4) evaluated at t = T becomes 



35 



( 5 ) 











1 


U2i(T) 


= C 




= 


0 






k e'“nT 


1 


0 

_ _ 



Multiplying (5) through hy we get 









‘l" 




1 

Cll 


(6) 




= c-1 

j 


0 

1 


- 


C 21 




_knie-nl 


1 

1 


loj 







where the c! . are elements of C”^, 

Therefore, the constants corresponding to solution 
Ui are determined to be as follows; 



(7) 



so that, substituting (7) back into (4) we get 



(8) 



Therefore, if in general wc choose the "special" 

iT 







11 


Cue ^ 




p* 


21 = 


C 2 1 ® 


•nl 


c' e“n^’ 
•^nl® 



uii(t) 










U2i(t) 


= c 




= c 




_UnPt)_ 




k e**“nk 

L. nl J 




c;^e“n(T-t)i 



solutions Uj - adjoint system 

such that u^^(T) = ~ J ^ i = 0 

^0 i ^ j 
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we get 



u^.(t) 


= c 


, mi(T-t) 

Ci-e 

e mgd-t) 
''2j® 






c’ .e“n(T-t) 

J 



so that, by grouping the n sets of solutions so obtained 
into a single matrix equation, we obtain 







■^12 


TJin 






0 




■'^21 


^22 


^2n 


= C 




0 


(10) 










• 

« O 

c 


• 




.^nl 


^n2 


u 

nn 




• 

• 

o 

• o 

1 


e%(T-t 



Since the are independent solutions to the adjoint 
system, a linear combination U = Uj + bjUg + .•. + ^n-l^n’ 

where the b*s are arbitrary constants, is also a solution. 

A solution obtained in this manner is called an adjoint 
vector . 

If ei, egj.e.oC^ represent the base vectors for an 
n-dimensional cartesian coordinate set, we can express the 
adjoint vector U as 

(11) U = I u i 

i 

where 

(12) = Uj^i + biUi 2 + + ^n-l^^in " l,2,..o,n) 

For a minimum- time path we choose F = F*" such that the 
components of f"*^ satisfy the relation 

(13) f^ = sgn u^ (i = l,2,,..,n). 
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From the Fundamental Adjoint Formula v/e have 



T T 

(14) [ Y, ^ ^ 

^ 1 1 o j ^ 1^^ 

which, upon successive substitution of the "special" adjoint 

solutions U. reduces to 
J 

r T ^ + 

(15) x.(T) = L u.j(0)x.(0) + j ( 4- dt 

for j = l,2,o.,n„ Equation (15) can also be witten in 
vector notation as 



(16) x.(T) 



(Uj.X)o 



T _ ^ 

(U.oF ) dt 
o 



(j — l,2,.o,n)> 



Again, as in the previous sections, \;e desire to drive 
the system from X(0) to X^ in minimum time T, We therefore 
consider a linear combination of the x.(T), using the constants 

J 

previously described in defining the adjoint vector. We have 

(17) Xi(T) + biX2(T) +O.C+ ' (U.F )dt 

o 

where U = Uj + bib 2 + ... + ^n-l^n adjoint vector. 

Comparing the resulting terminal state X(T) with the 
desired terminal state X^, we define the component errors 
as 

(18) AX^ = X^^ - x.(T) (j = 1,2, ...,n). 

If any AX. is not zero we must determine the changes in the 
input parameters required to effect X^., 





'.vi 

h '^-■'1 



Suppose the initial values of the input parameters are 



replaced by nearby values 
T T + 5T 

bj 5>bi+ 6bi 

(19) 



^n-1 ^^n-l"^ *^^n-l° 

Then the changes 6X. resulting in the terminal values ("•'■') 
can be expressed as (for j = l,2,.«.,n) 



(£0) 6X. = 

J 



(lio.x)^ + J (||;i.F'')dt + f^(T) 



» 

"I?* 






i=l k=l 


• 






^i i 


^ik 


n K-j 

z r 


'’in] 


-j 


1=1 k=l 


9 ] 

Ui / 


hk- 



n h^- 

i=l k=l ^ *ik 



6b 1 



oT 



6i 



n-l. 



Equation (20) has the form of the total differential 

(21) tfXj = §fj 6T ♦ f 3 6b, . . 



for (j — 1^2^ea«^n)« 

Setting hX. = 6X. and inverting the "correction" 

J J 

matrix defined by (21), we can determine the changes 

St, Sbi,...., required to effect X^, if the routine 

converges. 
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£. Conclusions and Comments, 

The solution of the minimum-time problem for second and 
third -order systems iv'as progracuned and run on the CDC-1604 
computer, using the hunge-Kutta-Gill method of numerical 
integration to calculate the required integrals. It has a 
desirable feature that it is easy to vary the time intervals 
any time during a run. 

The convergence of the differential-correction routine 

appears to be fairly critical, especially for stable systems. 

That is, if for a given set of input parameters the error 

- X(T) is too large, the routine will not converge. 

The sv;itching times t^^ tg for second -order systems vrere 

determined exactly, so that the degree of convergence v;as 

limited only by the degree of precision provided in the numerical 

integration (limited by the size of At) and other routines. 

Convergence of the routine was obtained to an accuracy of better 

“IS 

than six decimal places (AR^ =10 ), 

For the third -order systems the switching times v/cre not 
determined exactly? if a component of the optimum forcing 
function changed sign in a time interval At, it was assumed to 
have changed sign at the end-point of the Interval. In this 
case, convergence of the routine was limited to about three 
decimal places (AH® =- 10°°) for At = .005. Convergence to 
greater accuracy could be achieved by reducing the size of At 
in the numerical integration routine. 

The method of solution appears to be applicable to more 
general problems. The case where the end-point X^ varies v;lth 

time T may be handled by incorporating into the correction 
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equations (7ol£) a term involving dX^/dT, as v;as dene by 
Faulkner and Ward [lO] in a rocket trajectory problem. 

The solution curves have several interesting properties. 

As noted in section 5, if the solution for a second-order 
system has two switching times, the difference is a constant 
of the system. A proof is given here that this is generally 
the cases 

Let us consider a linear dynamic system represented by 
the system of differential equations 
(1) X = A X + F, 

which can be written in expanded form as 

{ 6 

x = ax + by + f lfl<l 

0 

y=cx+dy+g |g|<l 

where the elements a,b,c,d are constants, and the eigenvalues 
of A are real and distinct. 

The eigenvalues of matrix A (roots of the characteristic 

equation |A - mlj =0 ) are 

(3) ffij = a d + r mg = a d ° r 

2 ^ 2 

where 

(4) r = t/(a=d)^ + 4bc . 

The "special" solutions Uj, bg (described in earlier 
sections) of the system adjoint to (1) can be expressed jointly 
in the following matrix equation; 



(5) [Ui Ug] = 


Ug 


= C 






_Vj Vg_ 




0 



where C is the matrix of eigenvectors of -A*^, 
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The general scluticn U = Ui + kUg of the adjoint system 



can then be expressed as 



( 6 ) 



b = 



Vi Vg 



1' 

k 



C'e”'<T-t) Q 



\ L 



mad'-t) 



Let tj,t 2 denote the switching times of f and g respectively, 
i,e. , n(ti) = vCtg) = Oc 

Solving for C and C"^ by the methods described in 
Appendices I and II, v/e obtain the following expression for 
a and v evaluated at tj and t£ respectively: 



f u(t,) = 0 = 



(7) < 



a~d+r+2kc 



2r 



^ m2(T--y ^-a^^■d+r~2kc 



v(t 2 ) = 0 = e 



m 



i(T-t^ j 2b^^k(-a^^d^-r) 



r 



2r 



+ e 



2r 



-2b^^■k(a-d^♦^r ) 



2r 



A simplification of equations (7) can be made by using the 
relation r = m^ “m 2 . The reduced form is then 
( r(T-ti) _ a “ d 2kc “ r 

I 



d + 2kc + r 



(8) 



r(I-t 2 ) _ 2b - kr ° k(a»d) 
® 2b -*■ kr = k(a“d) 



If Me now consider the ratio 

.rd-ti) 



(9) 



- ^r(t 2 “ti) a“d+2kc-r 2b+ k r-k(a-d) 

r(T“t 2 ) a<=d+2kc+r * 2b-kr-k(a-d) 



which can be reduced to 

(10) = §4^- 



xl 



b - k(a-d) - k^c 

2 (a “ d + r) ' b - k(a-d) - k^c ’ 

v/e obtain the following relation between tj and t 2 : 

(11) t,-t, loEe ( § -• : a d l’ 

that is, the difference betv/een the switching times tj and t 2 
on a minimum-time trajectory is an invariant of the dynamic 
system. 
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On the other hand, switching curves or surfaces, \/hich 
have received much attention, seem to have no particular 
significance. They are not implicit in the differential 
equations, but depend on the particular problem. Typical 
switching curves are given in Illustration 2 for the case 
where the trajectory begins at the origin. In the same figure, 
the dotted lines indicate the boundaries to the points of 
static stability. 

The concept of using the adjoint system to calculate 
dif ferentials of end values is apparently due to bliss in 
his v/ork in ballistics [£]» In the problems solved here, 
an explicit solution to the adjoint system vxas obtained, 
which made possible the Integral formulas for the end-point X(T). 
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aPIEKDIX I 



Colution cf A System of Homogeneous Linear First-Order 
Differential Equations v;ith Constant Coefficients. 

Suppose v/e have the differential equation 

(1) i = B U 



where B is an n x n matrix with constant elements 
and v/ith real, distinct eigenvalues. 

Let us assume a solution of (1) of the form 

(2) U = e”*^ C 

where C is an n x 1 column matrix v/lth constant elements. 
Differentiating (2) with respect to t, we get 

(3) U = m e”^^ C. 

Substitution of (3) and (2) into (1) gives the follov;ing 
result : 



(4) 



mt ^ 
me C 

mt 



B C 



and, since e is a scalar quantity appearing on both 
sides of (4) , we have 
(5) m C = B C. 

Therefore, if m is an eigenvalue of matrix B, then C 
must be a corresponding eigenvector. Since there exist n 
distinct eigenvalues mj , m 2 , .< 
are n independent solutions of (1) of the form"' 



, of matrix B, there 
1 



( 6 ) 



= e®j^ C^ 






i *1 

v/here C c^j ^nj^ eigenvector corres- 

ponding to eigenvalue m ^ , and = [u^ u^ ..... u^ 



1, In this section only, m^ is associated v/ith solutions 
for U. ** 



The general rolution of (1) is then a linear combination 
of the , i . e . j 
(7) U = Z k . 



where the k. are arbitrary constants, 

V 

Componentwise, (7) may be written as 



(8) Uj = Z k.e^D^ 



'ij 



(r l,2,,oe,n} 
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AfiEKDlX II 



Determination oi the Components of Eigenvector C*^. 

we have the adjoint system of differential equations 

(1) i = -A^‘ U 

v/here a is an n x n matrix v;ith constant elements a^j^ and 
v/ith real, distinct eigenvalues. 

From Appendix I v;e know that the solution of (1) is 
of the form 

(2) iJ = Z k, e"“j^ 



T i 

where the -m . are the eigenvalues of matrix -A and the C 

J 

T 

are the corresponding eigenvectors of -A . The k^ are 
arbitrary constants. 

Differentiating (2) with respect to t we get 
(3) U = 



Lm.k. e"“^0^ 
0 ^ ^ 



th 

(4) u. 



The i component of (3) can be vnritten as 

i 



mjk. e J cjj, 



( 3 . ^ ^ ^ Q o 9 9 



th 



vrfe can also write the 1 component of (1) as 



( 6 ) 

. th 



O • • O 



^ni^n’ (i=l)2,..,,n) 



The i component of (2) can likewise be v/ritten 



as 



( 6 ) 



=-mit 

- ^ e J _ 



u. " Z k, e “‘I" c.. . , 



(i = 1,2, ,, , ,n) 



Substituting (6) into (6) we get 

-m4 1 



(7) 



( Z "'Cj^p ” ag^( z '"Co J 



-m^t 

'y 



9 « O O 



Since (4) and (7) represent equivalent expressions of 

the v/e can equate the corresponding coefficients of 

the k^e . For example, equating the correspcncing 

m t 

coef ‘"icients of kie” ^ we get 

(£) = “^ii*^ii " ^zl^zi " » ^ • “ ^ni^^'^^ ’ l,2,,.n)o 

Therefore, writing out all n of the equations obtained by 

m *L 

equating corresponding coefficients of kje” ^ we get 

-mjCii = -aiiCii - a2iC2i = o... - aj^iCni 

"^1^21 “ = ^22^21 ^ •••• “ a-nsCni 

(9) 

-niiCni “ “UmCii - ^zii'^zi ~ •••• ~ S-xmCni 

which can be v/i’itten as the following matrix equation; 



aii»mi a2i 

^12 S22”21i 


Sni 

Sn2 




ciT 

C 21 




) 

0 0 

\ 


Sin &2n 






SniJ 


f 

1 


0 



Denote by A the determinant of coefficients in (10) ■, 

For a nontrivial solution of the cj_i to exist it is necessary 
that A = 0, i»e., that 
(11) Ia'^' - niilj = 0« 

A solution of the cii consists of the cofactors of the 

T 

elements of a row of the matrix [A “ mj!], see Bellman [ 6]o 
This is the same as the cofactors of a column of [A - mjllo 
That is, the components of eigenvector are in the same 
ratio as the cofactors of the elements of a column of the 
characteristic matrix [A - mjllo 



4S 










(.aw 





Similarly, the components of the remaining eigenvectors 



C 



j 



can be found by using successively the 



ccfactcrs of the 



elements of a column of the matrices [A - 



m.I], 
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Illustration 1 



Computer Flow Chart for 



Solution of 



Order Minimum-Time Problem 



a. Form Characteristic Equation 
of matrix A» 



b. Find eigenvalues m. of A 

J 

(roots of Characteristic Eq.), 



c. 



Form eigenvectors C^ of 

= [cij cgj .»= 




d. Form C, the matrix of eigen- 
vectors of -Al\ 



e. Invert C to get C° 



f. Load initial values of the 
input parameters. 
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V - 



Region of Static Stability 
bounded by dashed lines. 



'4 




SPECIiiL SYMBOLS aKL N0T«TICM 



Symbol 


Meaning 


T 

X = [xi Xg .. x^3 


Matrix of coordinates , also called 
System state function. 


X = z 


Same 5 considered as a vector. 


R = xei + yea 
F = [fi fa .. f^]^' 


Same 5 considered as a vector. 
Forcing (Control) function. 


F = 1 fie. 


Same, considered as a vector. 


T 

U = [ui Ug .0 u^] 


Solution to adjoint system of 
differential equations. 



U = I u.e. = z b. tU. Adjoint vector 

1 1 J ^ j 



(bo = 1) 

U^= [uj ui ,, u^]^ 


j^^solution of adjoint system 

corresponding to eigenvalue “in., 

J 


U.= [U^^ U2j 


th 

j "special" adjoint solution 

such that U-. .(T) = 5^^ = | 1, i=j 
10 -0^0, i/j 


U. = I u, .e, 


Same, considered as a vector. 


= [ci j Cg j , , c^^j ] 


n. 

Eigenvector of -A"^ corresponding 
to eigenvalue 


C = [C^ c^] 


T 

Matrix of eigenvectors of , 


(UoF) = I u.f . 


Scalar product of adjoint vector 
and forcing vector. 




Base vectors of Cartesian coordinate 
set in n-space. 


A = (a^^) 


n X n matrix of coefficients. 


B = (bl,^) 
[A - ml] 


n X n matrix of coefficients. 
Characteristic matrix of 


[a - m^I] 


Characteristic matrix of 
associated with eigenvalue m., 

J 


|a « ml| =0 


Characteristic equation of a. 



Symbol 

Li 



Mean! nr 



■j V 



Diagonal matrix \;ith j ciagcnal 
element 



X(0) = (xi ,X2 , o Initial state of t^ynamic system 



X- = (X-, o « 5X «) Terminal state of (synamic system 

(specified) 

X(T) = (xi ,X2 5 . . ,x )n, Terminal state of dynamic system 

at time t = To 



T 

f 



Terminal value of time; also 
transpose v;hen used with matrix. 

Subscript f denotes final value. 



Bar over a symbol indicates that 
it Is a vector. 



I 

c » . 
ID 



AXi = Xj^^ = ^i^^^ 



Element of C 

Error in terminal value of i 
component. 



th 



= (U.F ), tj^<t<t 

cX 
61 



k+1 









[ ] 



‘ik 



jump discontinuity in variable 
at time t^^^^ 









*'lk 



Ik 












-t-'h 

k switching time of f. 
... k^e 






'ik 
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